Skip to content

test: retry transiently failed Actor builds in e2e make_actor fixture#970

Merged
vdusek merged 1 commit into
masterfrom
test/retry-e2e-actor-builds
Jun 12, 2026
Merged

test: retry transiently failed Actor builds in e2e make_actor fixture#970
vdusek merged 1 commit into
masterfrom
test/retry-e2e-actor-builds

Conversation

@vdusek

@vdusek vdusek commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

The E2E test test_custom_pipeline_spider failed in this CI run because the Actor build on the platform finished with status FAILED. This was a platform-side transient: the same commit passed the full E2E job on Python 3.11, and in the failing job the four sibling Scrapy tests built Actors with identical build inputs (same Dockerfile and requirements.txt) successfully. The build does not depend on the test's source files (they are only copied into the image), but it does run network-dependent steps (apt-get update, pip install --force-reinstall), which occasionally fail.

The make_actor fixture now retries a failed platform build once before asserting, which covers this flake class for all E2E tests. A deterministic build break still fails after two attempts, and the failed build ID is printed for debugging.

@vdusek vdusek added adhoc Ad-hoc unplanned task added during the sprint. t-tooling Issues with this label are in the ownership of the tooling team. labels Jun 11, 2026
@vdusek vdusek self-assigned this Jun 11, 2026
@codecov

codecov Bot commented Jun 11, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 89.88%. Comparing base (2cc5602) to head (a10967a).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #970      +/-   ##
==========================================
- Coverage   89.91%   89.88%   -0.04%     
==========================================
  Files          49       49              
  Lines        3085     3085              
==========================================
- Hits         2774     2773       -1     
- Misses        311      312       +1     
Flag Coverage Δ
e2e 35.98% <ø> (ø)
integration 56.95% <ø> (-0.04%) ⬇️
unit 78.70% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@vdusek vdusek requested a review from Pijukatel June 11, 2026 16:12
@vdusek vdusek marked this pull request as ready for review June 11, 2026 16:13
@vdusek vdusek merged commit 8c57582 into master Jun 12, 2026
28 checks passed
@vdusek vdusek deleted the test/retry-e2e-actor-builds branch June 12, 2026 09:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

adhoc Ad-hoc unplanned task added during the sprint. t-tooling Issues with this label are in the ownership of the tooling team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants